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PREFACE 


Host  If  not  all  Air  Force  problems  pertaining  to  system  optimization 
involve  more  than  one  criterion  function.  This  situation  is  often 
handled  by  altering  the  natural  problem  formulation  so  as  to  yield  but 
a  single  criterion.  In  recent  years,  however,  we  have  seen  more  and 
more  use  made  of  tradeoff-curve  analysis  (e.g.,  cost-benefit  analysis) 
based  on  the  concept  of  "efficiency."  A  system  is  said  to  he  operating 
at  an  "efficient  point"  if  no  criterion  can  be  improved  without  worsen¬ 
ing  at  least  one  other  criterion.  Analysis  in  these  terms  is  necessary 
to  preserve  the  conflicts  inherent  in  noncomparable  criteria,  thereby 
enabling  the  proper  blending  of  human  judgment  and  mathematical  analysis. 

In  this  study  we  reexamine  che  fundamental  concept  of  eificiency. 

The  possibility  of  certain  anomalous  situations  suggests  the  desirability 
of  a  slight  revision  of  the  customary  definition.  The  resulting  new 
definition  of  ef f iciency--which  we  call  proper  eff iciency--Lurns  out 
to  permit  a  very  satisfactory  theory,  a  matter  of  good  fortune  from  the 
applications  point  of  view.  Most  of  this  study  is  devoted  to 
developing  the  mathematical  foundations  of  this  theory.  The  results 
should  be  of  interest  to  systems  analysts  and  operations  analysts  with 
a  background  in  mathematical  programing . 

The  author  is  a  consultant  to  The  RAND  Corporation. 
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SlIMMARY 

The  concept  of  efficiency  in  problems  with  multiple  criterion 
functions-'Sometimes  under  an  alias  such  as  "admissibility"  or  "Pareto 
optimality"--has  long  played  an  important  role  in  economics,  game 
theory,  statistical  decision  theory,  and  in  all  optimal  decision  prob¬ 
lems  with  noncomparable  criteria.  Here  we  propose  a  slightly  restricted 
definition  of  efficiency  that  eliminates  efficient  points  of  a  certain 
anomalous  nature.  This  new  definition,  which  we  call  proper  efficiency, 
is  related  in  spirit  to  the  notion  of  "proper"  efficiency  introduced 
by  Kuhn  and  Tucker  in  their  celebrated  paper  of  1950;  but  the  present 
definition  avoids  certain  drawbacks  inherent  in  the  earlier  one.  A 
comprehensive  theory  of  vector  maximization  is  constructed  using  the 
new  definition,  with  and  without  various  constraint  qualification,  con¬ 
vexity,  and  differentiability  assumptions.  The  theory  includes  as  a 
special  case  the  standard  theory  of  nonlinear  programing. 
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I.  INTRODUCTION 


Given  a  vector-valued  criterion  function  f(x)  *  (f^(x),  ...»  f^(x)) 
and  a  set  X  c  Rn  of  feasible  points,  the  Vector  Maximum  Problem 


(VMP)  V-MAX  f(x)  subject  to  x  e  X 

is  the  problem  of  finding  all  points  that  are  efficient:  x°  is  said  to 
be  efficient  if  x°C  X  and  there  exists  no  other  feasible  point  x  such 
that  f(x)  >  f(x°)  but  f(x)  i  f(x°).  The  concept  of  ef ficiency- -sometimes 
under  an  alias  such  as  "admissibility,"  "maximality noninferiority," 
or  "Pareto  optimality"--has  long  played  an  Important  role  in  economics, 
game  theory,  statistical  decision  theory,  and  in  ail  optimal  decision 
problems  with  noncomparable  criteria. 

In  this  study  we  propose  a  slightly  restricted  definition  of 
efficiency  that  (a)  eliminates  efficient  points  of  a  certain  anomalous 
type;  and  (b)  lends  Itself  to  more  satisfactory  characterization  (see 
Theorem  2  below,  and  Sec.  II).  We  shall  call  this  new  definition  proper 
efficiency,  although  Kuhn  and  Tucker  [7]  have  previously  used  the  same 
term.  Their  intent  appears  to  have  been  much  the  same  as  ours  but,  as 
we  shall  see,  the  present  definition  is  of  greater  generality  and  seems 
to  be  somewhat  more  natural, 

PROPER  EFFICIENCY 

Definition  :  x°  is  said  tc  be  a  proper  efficient  solution 
of  (VMP)  if  it  is  efficient  and  if  there  exists  a  scalar 
M  >  0  such  that,  for  each  i,  f^(x)  >  f^(x°)  and  x  c  X  implies 

f^x)  -  f1(x°) 

fj(xo)  -  fj(x)  S  M 

for  some  j  such  that  f  (x)  <  f  (x°) . 
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An  efficient  point  that  is  not  properly  efficient  is  said  to  be 
improperly  efficient.  Thus  for  x°  to  be  improperly  efficient  means 
that  to  every  scalar  M  >  0  (no  matter  how  large)  there  is  a  point 
x  €  X  and  an  i  such  that  f^(x)  >  f^(x°)  and 

f.(x)  -  f.(x°) 
f j(x°)  -  fj(x)  >  M 

for  all  j  such  that  fj(x)  <  fj(x  ).  If  we  take  a  sequence  <M  >  “*  ® 

and  remember  that  there  is  but  a  finite  number  of  criteria,  we  see  that 

for  some  criterion  iQ,  the  marginal  gain  in  f^  can  be  made  arbitrarily 

o 

large  relative  to  each  of  the  marginal  losses  incurred  by  other  cri¬ 
teria.  Assuming  that  the  decisionmaker's  desire  for  f^  is  not  sati- 

o 

ated,  x  certainly  seems  undesirable.  An  example  of  improper  efficiency 
is  given  in  Sec.  III. 


CHARACTERIZATION 


A  matter  of  great  interest,  both  computationally  and  theoretically, 
is  the  relation  of  the  Vector  Maximum  Problem  to  the  following  scalar 
maximum  problem: 


<PX> 


MAX 


X  f  (x>  subject  to  x  c  X, 


where  the  X^  are  nonnegative  parameters  often  normalized  according  to 


t 


X^  ■  1.  The  fundamental  results  characterizing  proper  vector  max¬ 


ima  in  terms  of  the  solutions  of  (P^)  ate  given  in  Theorems  1  and  2. 


Theorem  1.  Let  X.  >  0  (i  -  1,  ...,  p)  be  fixed.  If 
x°  is  optimal  in  (P\)  ,  then  x°  is  properly  efficient 
in  (VMP). 


Proof:  It  is  obvious  that  x°  is  efficient.  We  shall  show  that  x°  is 
properly  efficient  in  (VMP)  with  M  ■  (p  -  1)  Max  {X./X,  }  (we  may  assume 
that  p  2  2) .  Suppose  to  the  contrary  that  for  some  criterion  i  and 


x  e  X  we  have 


fi(x)  -  fi(x°)  >M(fj(x°)  -  fj(x)) 
for  all  j  such  that  f j (x)  <  fj(x°).  It  follows  directly  that 
f^x)  -  f^x0)  all  i  f  1. 

Multiplying  through  by  X^/(p  -  1)  and  sunning  over  J  ^  i  yields 
Xi(fi(x)  -  fi(x°»>  j^Xj(f  j(x°)  -  fj(x)), 

which  contradicts  the  optimality  of  x°  in  (P^) . 

Theorem  2.  Let  X  be  a  convex  set,  and  let  the  f. 
be  concave  on  X.  Then  x°  is  properly  efficient 
in  (VMP)  if  and  only  if  x°  is  optimal  in  (P^)  for 
some  X  with  strictly  positive  components. 

Proof:  The  "if"  part  of  the  theorem  is  provided  by  Theorem  1.  If  x° 

is  properly  efficient,  then  there  exists  a  scalar  M  >  0  such  that  for 

each  i  (i  -  1,  ...,  p)  the  system 


f^x)  >  ft(x  ) 


ft(x)  +  M  f j (x)  >  f^x0)  +  M  fj(x°)  ,  all  j  /  i 


admits  no  solution  in  X.  By  a  fundamental  property  of  concave  functions 
[2,  p.  62],  for  the  ith  system  there  exist  xj  >  0  (J  -  1 . p)  with 
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P 

E  X 

j-1 


1 

J 


1  such  that 


or  equivalently  f .  (x)  +  M  E  X  f  (x)  £  f.  (x°)  +  M  E  X  f  (x°)  ,  tor  all 

j^i  J  J  J  J 

x  e  X.  Sunning  over  i  yields,  after  some  rearrangement, 

£u  +  m  *  id  +  m  ,(x°) 

j-i  i7j  J  J  j-i  i7j  j  J 


for  all  x  €  X.  This  completes  the  proof. 

Thus  from  a  computational  viewpoint,  finding  proper  efficient 
solutions  is  reduced  to  a  parametric  programming  problem;  (P^)  yields 
only  properly  efficient  solutions  as  X  varies  over 

A+  £  [X  e  RP  :  all  X  >  0  and  E  X  -  l}, 

i-1  1 


and  if  concavity  holds  then  this  approach  yields  al  1  properly  efficient 

* 

points . 

A  more  complete  characterization  theory  for  the  Proper  Vector 
Maximum  Problem  is  developed  in  the  next  section.  It  provides,  for 
example  ,  necessary  conditions  for  a  proper  vector  maximum  in  the  absence 
of  concavity. 

[n  this  regard  see,  for  example,  Charnes  and  Cooper  [3,  Ch.  9], 
Markowitz  [8*1,  and  Geoff rion  [4*1. 
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II.  THEORY 


We  shall  give  the  theory  of  the  Proper  Vector  Maximum  Problem  In 
terms  of  the  relationships  between  the  following  six  problems.  In 
problems  3,  4,  and  5 ,  X  is  taken  to  be  of  the  form  X  ■  [x:g(x)  >  O}, 
where  g(x)  *  (g^(x),  . ..,  g^x)).  In  problems  3  and  4,  the  differen¬ 
tiability  of  all  functions  is  presumed. 

Problem  1  -  Find  a  point  x  that  is  a  proper  efficient 
solution  of  (VMP) . 

-  * 

Problem  2  -  Find  a  point  x  that  is  a  locally  proper 
efficient  solution  of  (VMP). 

Problem  3  -  Find  a  feasible  point  x  such  that  none 
of  the  p  systems**  (i  ■  I,  ...,  p) 

Vxfi(x)*u  >  0 

Vxfj(x).u  *  0,  all  j  +  i 

VxgjU)*u  ^  0,  all  j  5  gj(x)  -  0 
has  a  solution  u  in  Rn. 

Problem  4  -  Find  a  feasible  point  x,  a  point  y  >  0 
in  Rm,  and  a  point  ^  C  A+  such  that  y.g(x)  =  0  and 


Vx[K*f(x)  +  y*g(x)]  =  0. 

Problem  5  -  Find  a  feasible  point  x,  a  point  y  >  0 
in  Rra,  and  a  point  K  '  A+  such  that  y*g(x)  *  0  and  x 
achieves  the  unconstrained  maximum  of  A*f(x)  +  y*g(x). 


Problem  6  -  Find  a  point  x  and  a  point  X  c  A+  such 
that  x  is  optimal  in  (P^). 


x  is  said  to  be  a  locally  proper  efficient  solution  of  (VMP)  if 
it  is  properly  efficient  in  N-  H  X,  where  N-  is  some  (open  convex) 
neighborhood  of  x. 

Vxcp(x)  represents  the  gradient  vector  of  the  function  evaluated 
at  x  =  x. 


/ 


Problem  1  is  the  central  problem  of  Interest.  Problem  2  is  its 


"local"  equivalent,  and  problem  3  is  the  local  problem  in  terms  of 
directional  derivatives.  Problem  4  represents  the  generalized  Lagrange 
uultipller  or  Kuhn-Tucker  conditions  in  differential  form  associated 
with  problem  1.  Problem  5  is  precisely  equivalent  to  the  following 
saddle-point  problem: 

Find  a  point  x,  a  point  y  >  0  in  Rm,  and  a  point  £  e  A+ 

such  that  the  pair  (x,y)  is  a  saddle-point  subject  to 

y  i  0  of  the  function  F(x ,y)  ■  f (x)  +y*g(x);  i.e., 
such  that  F(x,y)  ^  F(x,y)  ^  F(x,y)  for  all  x  e  Rn  and 
y  i  0  in  Rm. 

Problem  5  is  also  of  Interest  for  its  own  sake.  Problem  6  is  just  (P^). 

In  stating  the  relations  between  these  problems,  we  shall  use  the 


notation  j. 


,  ... 


•k,  which  is  to  be  understood  as  follows.  Let 


(u  ,v)  be  the  unknowns  of  problem  j  and  (u  ,w)  the  unknowns  of  problem 

k.  Then  this  notation  is  to  be  read:  "If  (u  ,v)  solves  problem  j, 

and  if  assumptions  A^  ,  . ..  hold,  then  there  exists  w  such  that  (u ,w) 

solves  problem  k."  Or,  somewhat  more  loosely,  "Under  assumptions  A^ , 

every  solution  of  problem  j  is  also  a  solution  of  problem  k." 

The  assumptions  that  will  be  used  at  one  time  or  another  are: 

Assumption  C:  All  functions  are  concave  on  En. 

Assumption  D:  All  functions  are  continuously 
differentiable  on  En. 

Assumption  Qi :  The  following  constraint  qualifica¬ 
tion  holds:  there  exists  a  feasible  point  x  such 
that  gj(x)  >  0  for  gj  nonlinear. 

Assumption  Q;:  The  Kuhn-Tucker  constraint  qualifica¬ 
tion  holds  L7.  p.  483 ] . 
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We  are  now  in  a  position  to  state  the  relationships  between  the 
six  problems. 

Theorem  (Comprehensive) 


C 

Ql 


Q, 


For  example,  the  Comprehensive  Theorem  asserts  (1  —  2)  that  every 

proper  efficient  solution  of  (VMP)  is  a  locally  proper  efficient 

C 

solution  of  (VMP),  and  (1  *"  2)  that  the  converse  is  true  under  Assumption 

C.  It  also  asserts  (5  -  6)  that  if  (x,y,X)  solves  problem  5,  then 

-  _  C ,Qi 

(x,\)  solves  problem  6;  and  (5  *  -  ■■  ■  6)  that  if  (x,\)  solves  problem 

6,  then  there  exists  a  point  y  e  Rm  such  that  (x,y,X)  solves  problem  5. 
Because  of  its  length,  we  give  the  proof  in  Appendix  A. 

The  Comprehensive  Theorem  is  actually  many  theorems  in  one.  Its 
significance  is  that  it  gives,  under  various  assumptions,  necessary 
and/or  sufficient  conditions  for  proper  efficiency.  In  order  to  be 
explicit,  we  state  the  most  important  of  these  conditions  as  three 
simple  corollaries  of  the  Comprehensive  Theorem.  Corollary  1  asserts 
that  under  Assumptions  D  and  the  conditions  of  problem  4  are  neces¬ 
sary  first  order  conditions  for  proper  efficiency.  Corollary  2  charac¬ 
terizes  problem  1  as  being  equivalent  (in  the  appropriate  sense)  to 
problems  2,5,  and  6  under  Assumptions  C  and  Q^.  Corollary  3  asserts 
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that  all  six  problems  are  equivalent  under  C,  D,  and  either  or  Q^. 

COR  1  -  If  Assumptions  D  and  hold,  then  problem 
2  “*  problem  4. 

COR  2  -  If  Assumptions  C  and  hold,  then  problem 
1  *•  problem  2  **  problem  5  **  problem  6. 

COR  3  -  If  Assumptions  C,  D,  and  either  Q  or  Q 
hold,  then  problem  1  **  problem  j  for  j  =2,  6. 

The  Comprehensive  Theorem  subsumes,  of  course,  the  cases  in  which 
there  are  no  constraints  or  only  equality  constraints.  Again  for  the 
sake  of  explicitness,  we  shall  state  the  main  results  for  these  cases 
in  Appendix  B. 

It  is  of  interest  to  note  that  in  the  special  case  all  of  the 
f^  are  identical  or  p  ■  1,  the  notion  of  proper  efficiency  coincides 
with  the  notion  of  a  constrained  maximum,  so  that  the  results  of  the 
Comprehensive  Theorem  reduce  to  well-known  counterparts  in  the  theory 
of  nonlinear  programming. 


III.  DISCUSSION 


We  turn  now  to  further  discussion  of  the  notion  of  proper 
efficiency. 

Just  how  slight  a  restriction  proper  efficiency  is  over  efficiency 

can  perhaps  be  better  appreciated  in  the  light  of  the  following.  Denote 

the  set  of  all  efficient  (properly  efficient)  points  by  (X^  ), 

pr. 

and  the  image  in  RP  of  X^  under  f  by  f [X  *j .  If  the  f^  are  continuous 

and  concave  on  the  closed  convex  set  X,  then  f[X^  ]  c  f[x^]  cr  f[x^  ], 

pr.  -  ~  pr. 

where  the  bar  denotes  closure.  This  result  is  a  consequence  of  Theorem 

•Jf 

2  and  a  result  due  to  Arrow,  Barankin  and  Blackwell  [l].  Thus  under 
the  given  conditions,  which  are  almost  always  satisfied  in  concave 
programming,  the  outcome  of  any  improperly  efficient  point  is  always 
the  limit  of  the  outcomes  of  some  sequence  of  properly  efficient  points. 


COMPARISON  WITH  THE  DEFINITION  OF  KUHN  AND  TUCKER 

The  notion  of  "proper"  efficiency  introduced  by  Kuhn  and  Tucker 
applies  only  when  assumptions  D  and  hold.  Under  these  assumptions, 
x°  is  said  to  be  "properly"  efficient  if  it  is  efficient  and  if  it 
solves  problem  3.  Let  us  denote  the  problem  of  finding  such  a  "properly" 
efficient  point  as  (X^,  3).  Then  the  results  obtained  by  Kuhn  and 

kk 

Tucker  are  (in  the  presence  of  D  and  : 

^  n 

If  S  is  a  closed  convex  set  in  R  ,  then  the  set  of  efficient 

points  of  S  contains  the  subset  of  points  of  S  for  which  there  is  a 
supporting  hyperplane  whose  normal  has  all  positive  components ,  and 
is  contained  in  the  closure  of  the  last  mentioned  set. 
kk 

Each  of  these  assertions  can  be  obtained  as  an  immediate 
corollary  of  the  Comprehensive  Theorem. 
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(i)  (X  ,  3)- 


4  [7,  Theorem  4] 


(ii)  4 - £— ►  (X*,  3)  [7,  Theorem  5] 


(ili)  (XS,  3)-*— 


5  [7,  Theorem  6]. 


To  Justify  excluding  efficient  solutions  that  are  not  "proper," 

Kuhn  and  Tucker  give  an  example  with  p  =  2  in  which  such  a  solution 

admits  a  first-order  gain  in  one  criterion  at  the  expense  of  but  a 

second-order  loss  in  the  other.  Indeed,  every  "improperly"  efficient 

* 

solution  poses  an  equally  objectionable  anomaly.  The  converse,  however, 

is  not  true--not  every  anomalous  efficient  point  is  "improper"  in  the 

sense  of  Kuhn  and  Tucker,  as  the  following  example  shows.  Put  n  *  1, 

2  3  o 

m  ■  1,  p  ■  2,  g(x)  *  x,  fj(x)  =  x  ,  f2(x)  *  -x  ,  x  *  0.  Assumptions 
D  and  hold,  and  x°  is  "properly"  efficient,  but  for  x  positive  and 
sufficiently  small  the  gain  in  fj  can  be  made  arbitrarily  large  with 
respect  to  the  loss  in  f2  (the  gain-to-loss  ratio  is  1/x  for  x  >  0) . 


Since  1- 


3  (see  Comprehensive  Theorem),  the  set  of  points 


"properly"  efficient  in  the  sense  of  Kuhn  and  Tucker  contains  all  those 
properly  efficient  in  the  present  sense.  The  above  example  (in  which 
x°  is  improperly  efficient  in  the  sense  of  Sec,  I)  shows  that  the  con¬ 
tainment  can  be  strict. 

To  summarize,  the  advantages  of  the  present  definition  of  proper 
efficiency  over  that  of  Kuhn  and  Tucker  seem  to  be  that  it  excludes  all 
of  a  precise  class  of  anomalies,  and  that  it  applies  even  in  the  absence 
of  Assumption  D  or  C^. 


7C  #• 

For  an  explicit  proof  see  Klinger  [6];  his  proof  seems  to  require 
the  locus  of  x(t)  in  the  definition  of  Q2  to  be  linear,  but  this  restric¬ 
tion  can  be  removed  (cf.  the  proof  of  2  ^>^2  »  3  in  Appendix  A). 
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CONCLUSION 


We  began  with  the  premise  that,  in  optimization  problems  with 
multiple  criteria,  it  is  natural  to  restrict  attention  to  efficient 
decisions  that  are  properly  so--in  the  sense  that  at  least  one  poten¬ 
tial  marginal  gain-to-loss  ratio  must  be  bounded.  We  then  obtained, 
in  Theorems  1  and  2,  basic  characterization  results  for  proper  efficiency 
in  terms  of  the  scalar  parametric  problem  (P^)  .  These  results  were 
extended  in  the  Comprehensive  Theorem  to  include  the  relationships  with 
four  other  intimately  related  problem  formulations,  with  and  without 
various  constraint  qualifications,  differentiability  and  convexity 
assumptions.  The  result  is  a  coherent  theory  of  the  Proper  Vector 
Maximum  Problem  which  generalizes  the  well-known  Kuhn-Tucker  theory  for 
nonlinear  programing.  This  theory  seems  more  satisfactory  than  that 
possible  using  either  the  usual  definition  of  efficiency  or  the  closely 
related  definition  of  "proper"  efficiency  proposed  by  Kuhn  and  Tucker. 


Appendix  A 

PROOF  OF  THE  COMPREHENSIVE  THEOREM 

C  , 

A.  1  ,  6 .  This  is  a  restatement  of  Theorems  1  and  2 

(with  \  normalized). 

C,Qi  D 

B.  6  _  *  5  ~~~  *  *  4.  These  assertions  are  all  known 

—“T - 

results  from  the  theory  of  nonlinear  programming  applied  to  (P.). 

C.Qi 

6  5  is  a  consequence  of  a  slightly  more  general  form  of 

the  Fa rkas -Minkowski  Theorem  [2,  p.  67]. 

5  ■■  ■■■  »  6  is  easily  verified  directly. 

D 

5  — »  4  occurs  because  the  gradient  of  a  continuously 

differentiable  function  must  vanish  at  an  unconstrained  extremum. 

C 

A  "  "»  5  occurs  because  a  concave  function  (which 

K*f(x)  +  y*g(x)  must  be,  since  K  >  0  and  y  >  0)  achieves  an  unconstrained 

supremum  at  any  point  for  which  its  gradient  vanishes. 

C 

C.  1  ,2.  1  ■  -»  2  is  trivial. 

Let  x  be  a  locally  proper  efficient  solution  in  the  neighborhood 
N-.  Under  Assumption  C,  Theorem  2  tells  us  that  x  maximizes  K'f(x)  on 
N-  fi  X  for  some  £  €  A+.  Again  from  Assumption  C,  x  must  maximize 
X*f(x)  over  X,  and  so  by  Theorem  1  x  must  be  properly  efficient.  Thus 


D.  3  •  ►  <4.  This  result  can  essentially  be  found  in  [7, 

Theorems  U  and  5], 

3  <  4  can  be  shown  as  follows.  If  (x,  y,  K)  is  a  solution 

to  problem  4,  then  1-  K  V  f.(x)  +  E  y  V  g.(x)  ■  0,  where  JA 
i-1  1  JCJ  J  x  J 

fj:gj(x)  “  oK  for  the  complementary  slackness  condition  y*g(x)  ■  0 
implies  y^  *  0  when  gj(x)  i  0,  Upon  postmultiplication  of  the  vector 


equation  by  u,  we  readily  see  by  contradiction  that  x  must  be  a 
solution  of  Problem  3. 

To  see  3  » 4 ,  let  x  be  a  solution  of  Problem  3  and  apply 

the  Farkas-Mlnkowskl  Theorem  in  turn  to  each  of  the  p  systems.  As  a 
result,  there  must  exist  numbers  wj  £  0  and  zj  ^  0  such  that,  for 
1  m  1>  •••>  p, 

Vf.OO  +  E  V*  V  f  U)  +  E  “  0. 

xi  jpfj,  J  x  J  jej  3  x  J 


Summing  over  i  yields 


P  i  Pi. 

E  (1  +  E  w)Vf.(x)  +  E  (  E  z)Vg.(x)  -  0. 

J-l  J  X  J  j«J  i-1  J  J 


1  -  P  i 

-  (I  +  E  w[)  ,  y  ■  (  I  zT)  for  J  c  J 
iVj  J  J  l-l  J 


_  _  *  P 

-  0  for  j  i  J.  Clearly  x,  X  -  X  /(  £  X.), 

1  L-l 

A  P  A 

-  y.  /  (  E  X.)  solves  Problem  4. 

J  l-l 

D,  Q2 

E.  2  ,  r  3.  We  have  previously  shown  3  ■  ■  >4 

c  c  c 

-  ».5  >6  »  1  ■■■  ♦  2;  hence  3-'  —  —  >  2.  To 

complete  the  proof  of  the  Comprehensive  Theorem  it  remains  only  to 

show  2  D<  Q2-»  3. 

Let  x  be  a  locally  proper  efficient  solution  of  (VMP)  ,  and  let 
Assumptions  D  and  hold.  Suppose,  contrary  to  what  we  desire  to 
show,  that  x  is  not  a  solution  of  Problem  3.  Then  one  of  the  p  systems, 
say  the  first,  has  a  solution:  there  exists  IT  such  that 


Put  X£ 

A 

and  yj 

and 
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Vx  f!  <*>  *  “  >  0 

Vx  fj  (x)  *  u  ^  0,  j  -  2 . . 

V  8j  (x)  *  u  s  0,  all  j  9  gj  (x)  -  0. 


By  assumption  there  exists  a  continuously  differentiable  arc 

A  A  — 

x(t) ,  0  £  t  $  l,  contained  in  the  feasible  region,  with  x(0)  -  x  and 

(d  5^(0)  d  xn(0)^  _ 

some  positive  scalar  or  such  that l — — . . — — I"  a  u. 

Consider  the  functions  f^(x(t))  .  From  Taylor's  Theorem  we  have 


£l  (x(t))  -  fL  (i(0»  +  t 


d  f^xU^) 
dt 


M  fL  (x) 


£ 

J-l 


a  fL(x) 


x(tL) 


dt 


» 


where  t^  is  some  scalar  between  0  and  t.  Denote  the  summation  in 
the  last  term  by  s^(t)  ,  so  that  f^(x(t))  ■  f^(x)  +  t  s^(t). 

Evidently  s^(0)  -  a  ^x  f^(x)  ’  u  and  s^t)  is  continuous  (from  the 
right)  at  t  -  0.  Now  for  t  sufficiently  near  0,  x(t)  is  in  the 
neighborhood  within  which  x  is  properly  efficient.  Consider  a  sequence 

V  V 

<  t  >  —  0,  where  t  >  0.  By  taking  a  subsequence,  if  necessary, 

we  may  assume  that  the  set  {j:fj  (x(tV))  <  f^  (x)  }  is  conscant  for  all 
v  --  call  it  J  .  We  know  that  <  Sj(tV)>  a  V*  f ^  (x)  •  u  £  0,  all 
j  c  J  .  But  8j(tV)  <  0  by  definition  for  all  v  and  j  c  J  ,  and  so 

<  Sj  (tV)  >  —  0  for  all  J  e  J  .  Furthermore,  <  s^(tV)  >  -*  or  ^x  f^(x)* 
u  >  0.  Therefore  the  sequences 
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f.  (x(tV))  -  f.  (x) 

<  - - TT“>  .  J  «  J  . 

fj  (x)  -  fj  (x(tV» 
which  can  be  written 


v  ,  v. 

y  c  sl(t  >  X 

<  ■  v  7  V' >  •  j  e  J  • 

-t  Sj(t  ) 


all  diverge  to  +  ®.  But  this  contradicts  the  local  proper  efficiency 
of  x,  and  so  x  must  indeed  be  a  solution  to  Problem  3. 
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AppendLx  B 

NO  CONSTRAINTS  AND  EQUALITY  CONSTRAINTS 


NO  CONSTRAINTS 

Here  we  consider  the  case  in  which  X  is  an  open  set  in  Rn  (perhaps 

the  whole  of  R°) .  Corollary  4  gives  necessary,  and  Cor.  5  sufficient, 

conditions  for  a  locally  proper  efficient  (l.p.e.)  solution. 

COR  4  -  Let  the  f^  be  continuously  differentiable  on  X. 

If  x°  is  l.p.e.,  then  <17  ‘  f  (x°)  }  =  ®  for  some  X  e  A+. 

Proof :  With  m  =  0  and  x°  e  X,  Qj  becomes  superfluous,  and  the 

D 

Comprehensive  Theorem  yields  2  •  »4. 

COR  5  -  Let  the  f^  be  twice  continuously  differentiable 
on  an  open  set  X  c  Rn.  If  x°  c  X  satisfies  V^X'^x')"]  M  0 
for  some  X  e  A  ,  and  the  Hessian  V  ^  TX-f(xJ)1  1®  negative 
definite,  then  x°  is  l.p.e. 

Proof ;  The  assumptions  imply  that  \«f(x)  Is  strictly  concave  on  some 

(convex)  open  neighborhood  Nxo  of  x°.  Hence  x°  maximizes  this  function 

on  Nxo,  and  so  by  Theorem  1  x°  must  be  l.p.e. 

It  is  clear  from  the  proof  of  Cor.  5  that  the  hypothesis  "f  twice 

2 

continuously  differentiable  and  ^xrX'f(x0)]  negative  definite"  can  be 
weakened  to"f^  continuously  differentiable  and  X’f(x)  concave  on  some 
neighborhood  of  x  .  " 

EQUALITY  CONSTRAINTS 

Here  we  consider  the  case  X  =  [x:gj(x)  =  0,  j  -  l,  ...,  m}. 

The  Comprehensive  Theorem  subsumes  this  case  i f  we  write  X  as 

m 

{x: g, (x)  s  0,  j  =  l,  ...,  m  and  -E  g  (x)  ^  0}  .  Assumption  Q.  is 
J  j=l  *■  l 
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..tuned  If  and  only  If  all  constraint,  are  linear;  and  the  direction. 

u  of  concern  In  Q2  are  those  for  which  V.gjOO-  '  1  *  1 . m' 

Corollary  6  Is  a  Lagrange  Kiltipller  Theorem,  and  Cor.  7  examines 

the  linear  constraints  case. 

00,6  .  Let  the  ft  and  gj  be  continuously  differentiable  on  some 
neighborhood  of  x°,  and  let  02  hold  at  x°.  If  x°  Is  l.p.e.,  then 


v  fx-f(x°)  +  P" g(x°)  1  -  o 
x 


+  m 

for  some  X  e  A  and  P  e  R  • 


D,Q2 


Put 


Proof:  The  Comprehensive  Theorem  asserts  2- 

“  Vj  '  Vr 

COR  7  -  Let  the  gj  be  linear,  and  the  ^  concave.  Then  each 
of  the  following  conditions  1.  necessary  and  sufficient  for 
x°  to  be  properly  efficient: 

(L)  x°  maximizes  X*f(x)  subject  to  g(x)  -  0 
.  +  # 

for  some  X  6  A  ; 

(Li)  x°  is  feasible,  and  maximizes  X*f(x)  +  p-g(x)  over 
ail  x  for  some  X  e  A  and  p.  e  R  5 
(til)  there  exists  p°  e  R  such  that  (x  ,  p  )  Is  a 


saddlepolnt  of  the  function  F(x,  u)  ■  X°  •  f  (x)  +  n'g(x) 
tor  some  X"  t  A+1  t.e.  ,  F(x°  ,  u)  *  H*°  ,  u°>  *  F(x,  „») 


n  • 

for  all  x  e  R  and  p  e  R  . 


If,  in  addition,  the  fj_  are  continuously  differentiable,  then 
a  fourth  equivalent  condition  is: 

(iv)  x°  satisfies 
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rx[X-f(x°)  +  n-g(x°>]  *  0 
g(x°)  =  0, 

for  some  X  e  A  and  n  e  Rm. 

Proof  :  Directly  from  the  Comprehensive  Theorem. 
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